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ABSTRACT ^\ 

A Study was conducted at Butte College to determ 

the effectiveness of the college * s assessment and placement program. 
Between January ±981 and STJtnuner 1982 , the Nelson-Denny Reading Test 
ahd a wri'fihg sample were used in placement; while after summer 1982, 
the Stah£6rd\f ask Tests of English and Reading Abilities were used. 
The primary file of data collected for the study cohtaihed 
ihforihatioh oh all 3,497 studehts whb_ had taken freshmah compositioh 



(Ehg 2101 betweeh wihter 
cohtaihed ihformatibh oh 
classes taught from fall 



1979_ahd fall 1983, whilethe secondary file 
all_191 developmehtal English (Ehg 1P2) 
1975 through summer 1J83. Statistical 
analyses of variance revealed: (1) student achievement had 
significantly increased since the college instituted its basic 
literacy skills assessment program in January 1981; (2) assessment by 
writing sample seemed to be part icularly effective in increasing 
student achievement in freshman composition and least effect ive in 
increasing achievement in developmen writing; (3) the Stanford 

Task instruments seemed more effective in increasing student 

achievement in deyeiopmentai wrj. ting than in freshman composition ; 
(4 ) basic skills abilities ^ as measured by high school grade point 
averages (GPA^s), of student's enter ing the college before and after 
assessment began were not significantlydifferent; however 
6PA*s increased significantly under both assessment programs. 
(AYC) 
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The Effect of Basic Skills Assessment on Stodent 
Achievemeht arid Persistence at Butte College 

. Iritrbductlori 

In January 1981, Butte College began a program of assessing 
basic literacy skills abilities for all students who wanted to register 
for freshman cbmpbsitlbri (ENG 210). Assessment - instrumerits included the 
Nelson-Denny Reading Test arid a writing sample. Scores were used to 
place stiiderits iritb apprbpriate levels bf writing classes. 

By Summer of 1982, the assessment prbgram was expanded to 
include all students whb wanted tb register fbr ariy English or Reading 
class i The assessment instruments were chariged to the Stariford Task 
Tests of English and Reading Abilities. Effective with the start bf the 
Fall quarter, 1983, all new students who wanted tb register fbr 9 units 
or more, as well as those who wanted to register for any English or 
Reading class, were given the assessment tests. Students are iibw placed 
into various levels of English classes based upon these scores. 
Further, counselors use assessment data to guide students into courses 
which are commensurate with student abilities. 

Although converitiorial wisdom would indicate that an assessment 
arid placement program should positively affect studerit achievement and 
persisterice^ questions are often asked about the effectiveness of both 
the assessmerit prbgram arid developmental classes into v/hich students are 
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- placed. This study addresses the coricerri d£ evidence of effectiveness* 

Data Collection 

Data were collected to form two data files. The primary file 

contains data on every student who has taken freshmin composition 

_ _ . _ _ _ *w 

(ENG 210) at Butte College between Winter quarter 1979 and Fall quarter 
1983 (20 instructional terms). This file^ consisting of 3497 student 
enrollment cases, includes: student identification number^ student 
gender, ENG ilO class master number^ the quarter ENG 210 was taken, the 
year ENG 210 was taken, the time of day that the ENG 210 class began, 
the ENG 210 class meetings per week, the Ibcatibh of the ENG 210 class, 
the ENG 210 class size, the ENG 210 teacher identification number^ the 
ENG 210 teacher gender, part- or full-time status of the ENG 210 
teacher, the grade the student received in ENG 210, the units the 
student completed while taking ENG 210, the units completed at Butte 
Cbllfige as of Summer 1983, the student's Butte College grade point 
average as of Summer 1983, the high schooit the student last attended | 
the student's high school grade point average, the student's ACT English 
score, the student's SAT verbal score, the student's score on the 
Nelsbn^Dehny reading assessment test, and the student's score on the 
Stanford Task English and Reading assessment testsi 

If the student tbbk a previous developmental writing (ENG 102) 
class, data were recorded including ENG 102 master number, the quarter 
the studerit tbbk ENG 102, the year the student took ENG 102, the time of 
day the ENG 102 class began, the ENG 102 class meetings per week, the 
location of the ENG 2.02 class, the ENG 102 teacher identificatibh 
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number i the ENG 102 teacher gender ^ part- or faii-tiine status of the 
ENG 102 teacher, and the units the student completed while taking 
ENG 102. 

The se'cbndary data file contains data on every ENG 102 class 
taught at Butte College from Fall 1975 through Summer 1983 (32 
iris tructibhal terras). This file^ consisting of 191 class cases, 
includes the ENG 102 master number; the quarter the class was offered; 
the year the class was offered; the time of day the class began; the 
number of class meetings per week; the location where the class was 
taught; the teacher idehtifi cation number; the teacher gender; the part- 
or full-time status of the teacher; and the number of credit (CR) 
grades, no-credit (NC) grades, withdraw (W) grades ^ and incomplete (I) 
grades assigned by the teacher* 

Data for the two files were collected from grade sheets ^ student' 
personnel files, assessment office records, student transcripts^ 

schedules of classes, and microfilmed records. As such^ the data are 

<" ____________________ ._ ■'. . 

properly classified as archival^ With the exception of grade point 

averages, placement and achievement test scores, class size, units 

completed, and terras between courses, the data are categorical^ Data 

structures for the two files are shown in Tables I and 2 on pages 4 

and 5. 

Primary Data File 

^ Data were recorded on 3497 cases of student enrollments in 
ENG 210 from Winter quarter 1979 through Fall quarter 1983. Student 

name and identification number; student gender; ENG 210 class master 

— 
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TABLE 1- 
Primary Data File Structure 



1. STID - student identification number 

2. SSEX - student gender 

3. CQN210 - ENG 210 class master number 

4. QTR210 - quarter the ENG 210 class was^ taken 
YR210_ - year the ENG 210 class was^taken 

6. TIM210 - time pf day the ENG 210 class began 

7. MT210 - ENG 210 class meetings per week 

8. L0C21P - ENG 210 class location 

9. SIZ210 - ENG 210 class ehrbllmerit 

10. INS210 - ENG 210 instructor code 

11. SEX21P - ENG 210 instructor gender _ ..^ 

12. TYP210 - ENG 210 in8tructbr__gart- or full-time status 

13. GR210 - student grade in ENG 210 _ _ 

14. UNI210 - units completed while .taking ENG 210 

15. C0N1P2 - ENG 102 class master number ' 

16. QTR102 - quarter the__ENG_102 class was. taken 

17. YR102 - year the ENG _102__class_ was taken 

18. TIMlp2 - time of day the ENG 102 class was ^ taken 

19. MT102 - ENG 102 class meetings per week 

20. L0C1C2 - ENG 102 class location 

21. SIZ102 - ENG 102 class enrdllment 

22. INS102 - ENG 102 instructor code 

23. SEX102 - ENG 102 instructor gender 

24. TYP1G2 - ENG 102 instructor part- or full-time status 

25. aNIlb2 - units completed while taking ENG 102 

26. BeUNIT - anits completed at Butte College as of Surnmer Session 1983 
2*7. BCGPA - ?^?^®_P9i^^ average as of Summer Session 1983 
28. HS - code for last high school attended 

29 i HSGPA - high school grade point average 

30. ACT - score on English section of the ACT 

31. SAT - score on verbal section of the SAT 

32. NEL - score on the Neison-Denny reading assessment examination 

33. ENGPL - score on the Stanford Task Engfish assessment exatsiinatidn 

34. RDGPL - score on the Stanford Task Reading assessment examination 

35. TRM210 - term the student enrolled in ENG 216 . 

36. - TRM102 - term the student enrolled in ENG Ji/P2 
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TABLE t 

Secondary Data File Structure 



1. 


CON102 




ENG 102 class master number 


2. 


QTR102 


- 


quarter the ENG 102 class was scheduled 


3. 


YR102 




year the ENG 102 class was scheduled 


^• 


TRM102 




tenn the ENG 102 class was scheduled 


5. 


TIM102 




irlme of day the ENG 102 class began 


6. 






ENG 102 class meetings per week 


7. 


L0C102 




ENG 102 class location 


8. 


INS102 




ENG 102 instructor code 


9. 


SEXr02 




ENG 102 instructor gender 


la. 


TYP102 




ENG 102 instructor part- or full-time sts^rus 


11. 


CR 




number bf credit grades assigned in the class 


12, 


NC 




number of nd-credit grades assigned in the class 


l3i 


W " 




number of withdraw grades assigned in the class 


14. 


i 




number of incomplete gradis assigned in the class 



ERIC 



.5 

number; the quarter > year^ and time of day of the ENG 210 class; the 
ENG 210 instructor name, identiflcatibh number^ gender, and part- or 
full-time status; and the student's grade xri ENG 210 were recorded from 
the ENG 210 grade sheets. Student transcripts were then examined to 
determine whether the student had taken a previous ENG 102 class and to 
record the units completed while taking ENG 210, the units completed at 
Butte College ais of Summer 1983, arid the studerit's Butte College grade 
point average as^_of Summer 1983. Studerit persdririel files were examined 
to record which high school the studerit had last atterided; the high 
school grade point average; and the student's scores brt the ACT Eriglish 
test, the SAT verbal test^ and^the NelBon-Denny reading test. Stanford 
Task English and Reading assessment test scores were recorded from 
assessment office records. Class location and beginning times were 
recorded from archival class schedules. Microfilm records were used to 
record data on students whose files were inactive. 

If the studerit had received a credit grade in a previous ENG 102 
class, the quarter and year of the student's enrollment were recbrded 
from the student's trariscript . If the student had repeated ENG 102, 
data were recbrded brily bri the mbst recerit successful class completibri 
prior to the ENG 210 class. The riumber bf uriits which the student 
completed while taking the ENG 102 class was also recorded from the 
transcript. The studerit was then traced by riame arid iderit if i'catibri 
narab.er through the ENG 102 grade sheets fbr the appropriate quarter and 
year tb recbrd data bri ENG 102 master riumber, the riumber of class 
meetings per week, the instructor name arid ideritif icatibri number, the 
instructor gender, and the part- or full-time status of the irtstriictbr. 

o 
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Glass location and time of day the class began were recorded from 
archival class schedules. Quarters and years of class offerings were 
used to code term identification humbets^ which were later used to 
compute the number of terms between classes • 

Data were recorded on 191 cases of ENG 102 classes from Fail 

* ' - 
quarter 1975 through Summer Session 1993. The course master number^ the 

quarter the class was of f ered, the year the class was offered^ the time 

of day the class began, the number of class meetings per week, the, class 

location, the teacher identtftcation nufflber, the teacher gender ^ the^^ 

part- or full-time status of the teacher, and the number of credit (CR) 

grades i rib-credit (NC) grades, withdraw (W) grades, and incomplete (I) 

grades assigned by the teacher were recorded from ENG 102 grade sheets* 

\ ' _ « 

Data Analysis 

The data files were analyzed using the analysts of variance 
program available- in the Statistical Package for the Social Services 
(SPSS) library of programs. Arielyses were carried out on the Butte 
College DEC PDP-11 ins true tibnal computer. 

• 

Finding s 

1 . Neither assessnent progrw sigt&lf icantly affected withdrawal 
rates in develbpaeatal writing (ENG lG2)i 

The 43 classes which we^e offered during the period in which 
students were assessed by writing samples had an average drop rate of 
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19.21%; The 146 classes which were offered outside this period had an 
average _drbp rate of 16.27%.. This difference is not significant 
(F-1. 52^ significance-. 2175. 

The 29 classes which have been of fered ' during the peribd in 
which students were assessed by the Stanford Task tests had an average 
drop rate of 20.33%. The 160 classes which were >^fered outside this 
period had ah average drop rate of 16.33%. This difference is not 
significant (F-2.085, significance-. 146). 

2. The percent of credit grades in develbplentai English 
162) iras not significantly affected by writing sv^le ussessBent. 

The 43 classes which were offered during- the period** in which 
students were assessed by the writing sample had an Average credit 
(success) rate of 62;66%. The 146 classes which were offered butside 
\^ . this period had arf average credit (success) rate of 58.99%.- This 

\; difference is not significant (F-l;223, significance-. 270). 

3. The percent of credit grades fn develbpiiental English 
(ENG 102) has increased significantly since Ifipletlentlng the Stanford 
Taak Instrunents. 

The 29 classes which have been offered since this assessment 
program began had ah average credit (success) rate of 67. 16%. The 160 
classes which were offered prior to this prbg?S had an average credit * 
(succeffs) rate of 58.49%. This difference ia significant (F-5.i39, 
stgnif icance=»;023); 

4. The percent of nb-^credit grades in developventai English 
(EHG 102) decreased significant ly during the period the writing sample 

• ^ ., ■ \- . ■ 

was used. ~ _ 

.' ' ^ ■ ■ / 10. . • . r 

o 
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The 43 classes which were offered dutihg the period Xh which 
students were assessed by the writing sample had ah . average ho-credit 
(NC) rate of 17.34%« The 146 classes which were offered outside this 

_ _ _ _ __ _ _. y 

period had an average no-credit (NC) rate of 24. 29%, This difference is 
stgniftcnt (F=-4.848, significance».027). 

5. The percent of no-credit grades in developiiental English 
(ENG 102) decreased significantly since it^lefientiiig tbe Stanford task 
instrunents. 

The 29 cla88es which have been offered since this assessment 

/■ . 

program began had an average no-credi^t (NC) rate of 12*02%* The 160 

• - ' ' L ■ " 

classes which were offered prior to tfii's pro^Eratn had an average rib- 
credit (NGJ rate of 24.65%, This difference is significant (F-12.272, 
significance-. 001 5. ' j- 

6. The percent of incomplete (I) grades in developmental 
English (ENG 102) was hot sighiflcumtly affected by either siBetsimmi 
program. ^ 

The 43 classes which were offered during the period in which 
students were assessed by writirig samples had an average incomplete (i) 
rate^of .79%. The 146 classes which were offered outside this period 
had an averge incomplete (I) rate of .45%. This difference is not 
significant (F«.667, significance-, 420). - 

The 29 classes which have been offered since the Starifbrd Task 
inst^umentJ3 were implemented had an average incomplete (1) rate of .49%. 

The 160 classes which were offered prior to this program had an average 

_ a:. _ . . . . _ ■ " ■■ . 

ihcbmpl^e (1) ratg'^o'f .53%. This difference is no t s ignif icant 

(F«.bb8, *sigriificance».890).- 



1 , A'verage de^eiopmental English (E1K? 102) blaiiii site bas lidt: 

-v^- - - 1 - - - - -- ' - ■- - / - •- 

changed stgntficantry during the period of either assessMedt program* 

The 43 classes which were offered during the. period in which 

students were asstessed by writing samples had ah average enrollment of 

. . ' _ . - __ _ * % ' . _ _ _ _ _ _ _ _ 

20i44i The 146 classes which were of fered> outside this period had an 

_ . ^ _ • » _i i 

average enrollment of 20.80. This difference is not s-ignificant 

(F=-,055, 8ignificance«.8br)i . 

The 29 cia3 8.es which have been offered 8in<|e the Stanford Taslc 

instruments were imp lementeohifed^n average enrbllment of 20.38. The 

160 classes which wete offered prior^ Lis^^his prbgraiL had an average 

enrollment of 20^78- This difference is* not^ sljgnificant (F««*05i; 

significance=.807)i . 

_ _ : -a ^ ■ 
' * _ _«_' 

8. Students who were enroi3.ed ±n derreiopsjentsl* English 

(£NG 1D2> during the petlbd when the writing sai^le wa^ used dlk" not get 
significantly higher grades in a subsequent frestintan covpodition 
(£NG 210) course. * 

. The 232 students who took ENG 102 during the period in which the, 
'iytiting sample was used were -as^Irghed an average ENG 210 grade o^ 2,.58, 
on a*4.00 scale. The 477 students who took ENG 102 outside this period 
were assigned .an. average ENG 210 grade of 2.54 on a 4«00 scale. This 
difference is not significant (F«.308, significance-. 586) . 

9. Students who were enrolled in developmental English 
(BSC 102) since the Stan|^rd task instruaents were ^implemented gbt 
significantly higher grades in a subsequent freshman compo'klclon 
(E!W 210) course. 
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' The 134 students who were enrolled in developmental English 
(ENG 102) since the impieinentation of the Stanford Task ihstxrumehts were 
assigned an average ENG 210 gradjj of 2*72 on a 4,00 scale. The 575 
.students vho were enrolled in developmental English (ENG 102) outside of 
this period were assigned ati average ENG 210 grade of 2,51 on a 4,00 
scale. This dif f erenc^^>^nif icarit (F'^5,936^ §ighif icance=.014) . 

10, Students who were enrolled, in developmental English 
(ENG 1025 daring both assessaent programs showed a higher, but not a 
statistically significantly higher » persistence ^iii a subsequent fresbaan 

coaposition Class. • — — 

Eighty-two percent of the 2'8^ students who took ENG 102 during 

_ _ . _ _ : 

the period in which the writing sample was used persisted in the 
subsequent ENG 210 class. Eighty percent of the 598 students who took 
ENG 102 outside this period persisted in the subsequent ENG 210 class. 
This difference is not significant (F-.496, signif icance«.488) . 

Eighty-five pierceht of the 162 students who tbbk ENG 102 during 
the period since the Stanford Task test were implemented persisted in 
the 8ubse({uerit ENG 210 class. Eighty percent of the 718 students who 
took ENG 102 before this period persisted in the subsequent ENG 210 
class. This difference is not significant (Fsi.72i significance « 
.187). • 

11. Students who enrolled in freshman co^>b8itibn (ENG 210) 
during the period when the writing savple was used received 
significantly higher grades in that class. 

The 707 students who enrolled in and compLeJtedzJlN6-^2t0^^ 
^he_.period-^--^h~icTr7^he writing sample was used received an average 
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grade of 2,82 on a 4;bO scale. The 2148 students who enrolled in and 
completed ENG 210 outside this period received an average grade of 2.58 
on a 4,00 scale; This difference is significant (F-36.368j significance 
<ibdl)i 

12. Students who enrdllecf lii freshman cbi4>b8ltlcHi (EHG 210) 
since the Stanford Task Instruiients were Implemented received higher^ 
bat not statistically significantly higher^ grades in that class. 

The 636 students who enrolled in and completed ENG 210 since the 
Stanford Task instruments were implemented received an average grade of 
2;69 on a 4.00 scale; The 2148 students who enrolled in atid completed 
ENG 210 before this period received an average grade of 2;58 on a 4.00 
scale. This difference is not significant (F-2. 05, significance-. 148). 

13. Students lAo enrolled in freshman composition (ENG 210) 
during the period when the writing sample was used showed fa±gher» but 
not statistically significantly higher » persistence In that course; 

Eighty-four percent of the 843 students^ who enrolled in ENG 210 
during this period persisted to completion in that ciasis. Eighty-one 
percent of the 2654 students who enrolled'ih ENG 210 outside this period 
persisted to cbmpletibh in that class. This difference is not 
significant (F»2;512> significance-; 109); 

14. Students who have Enrolled in freshman cbmpbsltlbn 
(EN6 210) since the Stanford Task instruwiits were Implemented persist 
In that course at 'about the same rate as before the assessment program. 

Eighty-one percent o^ the 798 students who enro lled in ENG 21 0 
since the Stanford Ta?k instruments were implemented persist to 
completion in that course. Eighty-two percent of the 2699 students who 
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enrolled in ENiS 210 prior to this assessment program persisted to 
completion in that; course. This difference is not significant (F«li26, 

8igriificance=.261). 

— -_ _ _____ _ __ i 

15. Student abilities as measured by higti school grade point 

averages were not significantly different during the period In ^ilch 

either assessaent program was In effect* 

The mean high school grade point average of 375 students who 
enrolled in ENG 210 during the period in which the Writing sample was 
used was 2.77 on a 4,00 scale. The mean high school grade point average 
of 1251 students who enrolled in ENG 210 outside this p»eri6d was 2.78 oh 
a 4.00 scale. This difference is not significant (F«.088^ 
significance»'.760) • 

The mean high school grade point average of 296 students who 
enrolled in ENG 210 since the Stanford Task instruments were irapleniented 
was 2.77 on a 4.00 scale* The mean high school grade point average of 
1330 students who enrolled in ENG 210 prior to this period was 2i78 on a 
4.00 scale. This difference is not significant (T-.2a8, 
signif icance=*.631) . ^ 

16. Student achievement as measured by Botte College grade 
point averages was significantly higher during the period dS both 
assessKnt programs. 

The mean Butte College grade point average of the 843 students 
who enrolled in ENG 210 during the period "^h which the writing sample 
w^a8'^8ed~~wO '2.92 oh a '4 .00 scale. The mean Butte College grade point 
average of the 2654 students who enrolled ixi ENG 210 outside this period 
was 2.79 on a 4.00. scale. This difference is significant (F-16.12> 
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signif icance-ibdb) i 

The mean Butte College grade point average of the 798 students 
whb enrolled in ENG 210 since the Stanford Task instruments were 
implemented was 2.88 on a 4.00 scale. The mean Butte Goliege grade 
point average of the 2699 students who enrolled in ENG 210 prior to this 
period was 2.80 on a 4.00 scale. This difference is significant 
(F«-5.22^3, significance-. 021). 

Coiiclu sirbns 

Student achievement at Butte College has aighif icahtly increased 
since the college instituted basic literacy skills assessment programs. 
Assessment by writing sample seems to be particularly effective in 
increasing student achievement in freshman coinpbsi tidn and least 
effective in increasing student achievement in developmental writing. 
The Stanford Task instruments seem to be particularly effective in 
increasing student adhievemeht in deveiopmentai writing and least 
effective in increasing student achievement in freshtaan composition. 

Both programs appear to be effective in increasing student 
achievement as measured by Butte College grade point average. The basic 
skills abilities, as measured by high school grade point averages^ of 
students entering Butte College before and after assessment began were 

not significantly different; however, Butte College grade point averages 

J^n^reasBd^sig^^ 

early diagnosis of basic skills weaknesses, in cbmbiaatibh with a 
placement program whereby these weaknesses can be corrected^ has a 
positive impact throughout their cciiiege expert^ce. Assessment data 
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may also help students arid their cburiselbrs to decide which classes are ' 
most appropriate for the studerit. 
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Figure l9i freshman Goraposition Enrollments by Year 
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Figure 20. Developmental Writing Enrollments by Year 
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